The Complexity of Vector Spin Glasses 
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We study the annealed complexity of the m-vector spin glasses in the Sherrington-Kirkpatrick 
limit. The eigenvalue spectrum of the Hessian matrix of the Thouless- Anderson-Palmer (TAP) free 
energy is found to consist of a continuous band of positive eigenvalues in addition to an isolated 
eigenvalue and (m — 1) null eigenvalues due to rotational invariance. Rather surprisingly, the band 
does not extend to zero at any finite temperature. The isolated eigenvalue becomes zero in the 
thermodynamic limit, as in the Ising case (m = 1), indicating that the same supersymmetry breaking 
recently found in Ising spin glasses occurs in vector spin glasses. 
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The recent renewed interest in the complexity of spin 
glasses has produced new insights into their properties 
111 H 0. The 1980 calculation of the complexity of the 
Ising Sherrington-Kirkpatrick (SK) model by Bray and 
Moore (BM) [j| has been confirmed but new features 
of it have now emerged. For that model the complex- 
ity is the average number of solutions, (Ns)j, of the 
Thouless- Anderson-Palmer (TAP) equations [5(- The 
Hessian matrix associated with these solutions (the ma- 
trix d 2 F/dmidmj), where F is their free energy and 
mi = (Si) is the local magnetization has to have no neg- 
ative eigenvalues for a solution of the TAP equations to 
be a minimum of the TAP free energy. The eigenvalues 
of this matrix have been found to form a band such that 
the smallest eigenvalue in the band is positive, together 
with an isolated eigenvalue which is zero in the large N 
limit, where N is the number of sites. For N large, the 
solutions of the TAP equations occur in pairs, with one 
solution corresponding to a minimum of the free energy 
and a small positive value for the isolated eigenvalue and 
the other solution corresponding to an (index-one) sad- 
dle point of the free energy F, with the isolated eigen- 
value being small but negative. The appearance of a null 
eigenvalue in the large N limit can be attributed to the 
breaking of a supersymmetry 0, 0, H @ ~ the BRST 
supersymmetry [l(| - possessed by the action that ap- 
pears in the evaluation of (N$)j pT| . 

To date only the complexity of the spherical p-spin 
model has been studied in as much detail as that of the 
Ising SK model. For this model the supersymmetry is un- 
broken and so the isolated eigenvalue is no longer a null 
eigenvalue |l2j . The minima are genuine mimima of the 
free energy and not just turning points as in the Ising 
case. The dynamical consequences of this difference in 
the value of the isolated eigenvalue are striking. For the 
Ising model, the TAP states, being turning points only 
of the free energy, do not trap the system near them for 
any substantial period of time, whereas in the spherical 
p-spin model the system evolves from its initial state and 
becomes trapped for ever near the TAP solution accessi- 



ble from the initial state [13|. 

In this paper, we examine the complexity of mod- 
els which are often closer to experimental spin glasses 
than the Ising spin glass, namely, the m-vector spin glass 
models. They include the XY (m = 2) and Heisenberg 
(to = 3) spin glasses. We studied also the eigenvalue 
spectrum of the Hessian matrix of the TAP free energy 
for this model. This was previously obtained at zero 
temperature in Refs. |lJ,|ljg. We show below that the 
eigenvalue spectrum at finite temperature consists of a 
continuous band of positive eigenvalues, together with 
(to — 1) null eigenvalues due to rotational invariance and 
a further null eigenvalue (in the thermodynamic limit) 
whose origin is as for the Ising spin glass Q. We had 
expected that the band edge would be at zero due to the 
rotational invariance in these models, as found at zero 
temperature, but in fact there is a small but finite gap 
when < T < T c . 

The m-vector SK spin glass model has Hamiltonian 



H = 



rn 
T 



•s, 



(1) 



where the 
1 , . . . , to, i 



m-component spins Sj = {Sf}, (a = 
= 1,...,N) of unit length Si = 1, and 



the interactions have a Gaussian distribution with 
zero mean and variance l/N so that T c = 1 for all to. 
The TAP equations for the local fields hi at temperature 
T — (3^ 1 are given in terms of the local magnetization 
variables mi = (Si) by 



Jijm?-p(l-q)m?, 



(2) 



where q = N 1 J2i m i > an d is related to hi by mf = 
hfL(m(3hi). The function L(x) — Im. (x)/J m-2 (x) and 

I v (x) is a modified Bessel function. Here hi = h,/ hi. 
The TAP equations are obtained by extremizing the free 



2 



energy 



dT 



lnz(m/3/ii) 



(3) 



with respect to mf, where z(x) — I m-a (x)/(%) m 2 
(lif. Using the TAP equations, J3J), the free energy can 
be written as f3F/N = N^ 1 £\ f(mPhi) where 

f{x) = -l m /3 2 (l - g 2 ) + ~L(x) - ln*(x). (4) 

Following the number Ns(f) of solutions to the 

TAP equations with free energy / per spin is given by 

N s (f) = N 2 J dq J 'IJ dm? J n^ Q |dctK| (5) 

i.a i,a 

x n s ( h ? - E J » m ° + ft 1 - «)<) w) 

i,a j 

xS^Nq-Y, m?) S (Nf - f{m0hij). 

i i 

Here Hf — mf — hfL(m/3hi) and the matrix K is such 



that K°/f = dHf/dm p . = V C^Atf, where 



«7 A 7/3 



gap _ pa/3 ( I. Ull ill,) \ ~ m ~ . 



0hi 

with P a/3 = 5 al3 - h?RP and 



h?h?mL'(mf3hi) (6) 



.4 



a/3 



(7) 



The matrix A is just the Hessian matrix of the TAP free 
energy given by A"? = d 2 (PF/m)/dmfdmj. 

Averaging the number of solutions JSJ over the Jy dis- 
tribution, we obtain 



N 
where 

/ = 



-mAq—uf -jA 2 -m(l-g)A + ln/, 

2p 

(8) 



T(f ) \2q 



dhh r 



exp 



+uf( m ph) -J!jL-(j3h- AL(mph)) 



mAL 2 (mPh) 

2n 



(9) 



The parameters q, A, A and u were originally introduced 
as integration variables and are fixed according to the 
steepest descent method to make the right hand side of 
Eq. (JHJ stationary. The corresponding saddle point equa- 
tions for these variables can be derived in a straightfor- 
ward way. We have solved them numerically for tem- 
peratures T < T c . The calculation for the total number 



of solutions (Ng)j ~ e NT -( T ) is done by setting u = 0. 
We have evaluated £(T) as a function of temperature T 
for the XY and Heisenberg cases. We find that £(T) in- 
creases with decreasing T, approaching the known T = 
values, S(0) = 0.02328 for m = 2 and S(0) = 0.00839 for 
77i == 3 and vanishes as T approaches T c . 

We now turn to the determination of the eigenvalues 
of the Hessian matrix A. In Eq. ©, both P" 13 and 
hfhf are projection operators, therefore, the eigenvalue 
spectrum of C" 13 is simple: one eigenvalue mL' (mphi) 
and (m — 1) eigenvalues L(mphi) / phi- They are both 
positive. For convenience, we denote by B"j the part 
of the matrix A without the final 0(1/ N) term in 0: 



.4 



a/3 



B, 



a/3 2f3 2 



- ]\r m ? m f- The 0(1/ N) term has the form 

of a projection operator and does not contribute to the 
extensive part of the complexity S(T). For the computa- 
tion of Yi(T), we can drop the the modulus sign around 
K in © H . We will find below that, as in the Ising 
spin glass case, the projector term produces an isolated 
eigenvalue of value zero 0] . 

We calculate the eigenvalue density p(X) of the Hessian 
matrix B without the projector term using the resolvent 
matrix 

G(A) = (AI-B)- 1 , (10) 
where I is the (mN x mN) unit matrix. We can write 

p(X) = ^- Im Tr G(A - iS), (11) 

where S is a positive infinitesimal. We use the locator 
expansion method 0] to calculate p(X) in the thermo- 
dynamic limit. The eigenvalue spectrum consists of two 
branches, transverse and longitudinal, which are denoted 
respectively by pt and pi. We can write 



p(X) = (m-l)p t (X)+ Pl (X). 



(12) 



Each branch is obtained from the corresponding resol- 
vent matrices: Pt(X) = 7r Im G t (X — id) and pi(X) = 
7r _1 Im G~i(\ — id), where 



A 



Tr G(A) = G(X) =(m- l)G t (X) + Gi(X). (13) 



The functions Gt(X) and Gi(X) satisfy 

ph 



Gt(X) 



Gi(X) = 



X-p 2 (l-q) 



X-p 2 (l-q)- 



L(mPh) 



1 

mL' (mPh) 



P 2 G(X) 



P 2 G(X) 



(14) 



(15) 



where the averages were evaluated over the weight func- 
tion in the integrand of Eq. JjJ}. In order to solve the 
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FIG. 1: The transverse and longitudinal eigenvalue densities, 
pt(A) (solid lines) and pi (A) (dashed lines), respectively, of 
the Hessian matrix for T = 0.2 and u = (excluding the 
delta functions associated with null eigenvalues). Thick lines 
correspond to m = 2 (XY spins), while thin lines are for 
m = 3 (Heisenberg spins). The inset shows the behavior of 
these quantities at small values of A, which clearly indicate 
the presence of finite gaps in the spectrum. 



above equations, we separate G*(A) and G;(A) into real 
and imaginary parts. The resulting four coupled equa- 
tions are solved numerically to yield p*(A) and pz(A) for 
given temperature T. The results for T = 0.2 are shown 
in Fig. ^ We find that, as T approaches T c , pt(A) and 

(A) become equal, but in the low temperature limit 
T — > 0, however, the longitudinal eigenvalues become 
harder and harder. This is already apparent at T = 0.2 in 
Fig.^ where pt is much larger than pi except at large val- 
ues of A. One of our main findings is that, for < T < T c 
and for finite m, the continuous part of the eigenvalue 
spectrum does not extend to A — as there is a very small 
but finite gap which can be seen in the inset of Fig. ^ 
This is in contrast to the behavior at zero-temperature 
of the same model |15|, where the lower band edge is at 
A = for all to, and the large-m limit where explicit solu- 
tion of our equations shows that the spectrum is gapless 
at all temperatures below T c and given by the well-known 
semi-circle law: p m ^, 00 (X)/m = ^/A(4/3 — A) / (2tt (?) . 

For A small, we can obtain analytic solutions to 
Eqs. 114fl and 115|) . Expanding these equations in powers 
of A - (3 2 [G{\) - G(0)], we find that both longitudinal 
and transverse branches show a square-root dependence 
but with different overall coefficients. We find 




(16) 
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L(mf3h) 
0h 



— ((mL'(m(3h)) 2 ) 

TO 



P = P 2 



1 

1 

TO 



L(mf3h) 
(3h 



— ((mL'(m/3h)) 

TO 



and 



L(ml3h) 



x p i L(m(3h) 



ci = {{mL'{m(ih)f 



P 



{(mL'(m/3h)f 



, (17) 

(18) 

>, (19) 
(20) 



P 

Note that (m — l)c t + q — m/(3 2 so that the total den- 
sity p(A) ~ m^J A — x 2 / (Ap) / (it 1 ^fp) . Our numerical 

solutions for small A agree quite well with the square- 
root behavior. In the limit m — > 1, mi — L{j3hi) = 



tanh(/3/ij), and therefore x f 



1 



/? 2 ((1 



,2\2\ 



and 



P = P 2 iLk ~ m f) 3 ) ~ the known results for Ising spin 
glasses |l7j . 

We have directly evaluated the parameter which deter- 
mines the gap in the expression (|16fl . In order to compare 
with the T — result, we consider the Hessian obtained 
from differentiating F/m instead of (3F/m. The eigen- 
values will then be scaled as A' = X/f3, and therefore, 
the gap in the small- A' spectrum is now determined by 

x 2 

the gap parameter . This quantity was evaluated as a 
function of temperature with the results shown in Fig.|3 
It vanishes both at T = and T = T c as expected. The 
figure also suggests that the gap becomes even smaller 
when the number of components m gets larger, which is 
consistent with the result of no gap at all in the large- 
to limit. Based on the behavior of the Ising case 0], we 
would expect x p to tend to zero for the TAP states whose 
free energies approach those of the pure states. In other 
words, the TAP solutions with the lowest free energy will 
be gapless at all temperatures. 

At first sight, the appearance of a finite gap in the 
eigenvalue spectrum at finite temperature is rather puz- 
zling, since the continuous rotational symmetry of the 
vector spin glass model would suggest the existence of 
null eigenvalues associated with a uniform rotation of all 
the spins. One can indeed show that the Hessian ma- 
trix in the form of Eq. (JZJ) admits (to — 1) null eigenvec- 
tors in the transverse sector as follows: note first that 
( C -i)a/3 = (gap _ fhffh^)K{mi)/mi + fhfm?K'(mi), 
where K (x) = _L _1 (x)/to. For (to — 1) vectors £i satis- 
fying • in; = and £j = TOj, it is easy to show that 



£j=0 using the defining TAP equations. 



apt/3 = 
ij ^3 

The analysis of the effect of the 0(1/ N) projector term 
in the Hessian matrix closely follows that for the Ising 
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FIG. 2: The parameter x^/Afip that determines the size of 
the gap in the Hessian spectrum as a function of temperature 
T for m = 2 (triangles) and m — 3 (squares). 

case Q. There is an isolated null eigenvalue outside the 
main band in the longitudinal sector if 



2/32 
N 



-£J2<( B ~ 1 )?f m j= 2 P 2H = 1 ( 21 ) 



i>3 afi 



with the eigenvector vf = ^ ■ AB rrij. We evaluate 
H using the expression 

{ b-%? = vdeiB/ n (%) m 

xexp[-^^C«] (22) 

then insert H into the integrand of JSJ) . The rest of the 
calculation involves the evaluations of various Gaussian 
integrals and can be done as for the Ising case , except 
that there are extra indices for the vector components. 
We obtain 



H = 



q 2 A 3 



(Ai - q)* - A 3 (A 2 - q(l - q)Y 



(23) 



where 



At = (L{m(3h){l3h - AL(m(3h)}mL' (m(3h)) , (24) 



({/3h - AL(mf3h)} z mL'(mf3h)}, (25) 



The averages are evaluated with respect to the integrand 
of The expression for H is exactly the same as the 
one for the Ising spin glass case (Eq. (10) of Ref. Q) but 
with the quantities A\, A2, and A3 generalized to the 
m- vector case. The numerical evaluation of the required 
integrals reveals that 2(3 2 H = 1 for all T <T C and at all 
values of u. 



Therefore, in the thermodynamic limit, the Hessian 
matrix of the to- vector TAP free energy is positive semi- 
dchnite with exactly to eigenvalues equal to zero; the 
vanishing of (to — 1 ) of these eigenvalues is a consequence 
of rotational invariancc but the vanishing of the isolated 
longitudinal eigenvalue indicates that the TAP states for 
vector spin glasses will behave like those for Ising spin 
glasses. This means that there will be only minima and 
index-one saddles at large but finite values of N. Dy- 
namically the vector spin glasses will behave more like 
the Ising spin glass than p-spin models. For example a 
state with remanent magnetization will evolve in time to 
a state with zero magnetization for all the vector glasses, 
whereas for p-spin models, remanent magnetization re- 
mains forever - all because the existence of the null lon- 
gitudinal eigenvalue means that the TAP states in vector 
spin glasses are just turning points of the free energy and 
so are unable to trap the system in their vicinity. 



A 3 = (L 2 {mj3h)mL'(mf3h)}. 



(26) 
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